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This  project  supported  the  graduate  research  training  of  Robert  Joyce,  who  is  com¬ 
pleting  his  Ph.D.  studies  in  the  Department  of  Electrical  Engineering  at  Princeton  Uni¬ 
versity.  Mr.  Joyce  began  his  graduate  studies  with  interests  in  wavelet-based  processing 
for  multimedia  sources  (particularly,  images  and  video),  but  his  research  evolved  to  fo¬ 
cus  on  the  problem  of  content  analysis  of  video  sequences.  His  research  contributions 
on  this  problem  have  been  supervised  by  Prof.  Bede  Liu  at  Princeton  University,  with 
collaborations  both  with  me,  Prof.  Michael  Orchard  (currently  at  Rice  University),  and 
Prof.  S.-Y.  Rung  at  Princeton.  His  work  with  Prof.  Liu  has  produced  a  conference 
paper  [3]  and  a  journal  submission  [1],  proposing  new,  low-complexity  algorithms  for  de¬ 
tecting  scene  changes  in  video  sequences.  Mr.  Joyce’s  collaborations  with  Prof.  Kung’s 
group  has  produced  two  conference  papers  [4,  5]  and  a  journal  publication  [2],  This  work 
applies  video  content  analysis  to  guide  dynamic  resource  allocation  for  transmission  of 
video  over  the  Internet. 

Content  analysis  of  video  sequences  is  a  critical  component  of  virtually  any  appli¬ 
cation  involving  the  management  of  large  video  data  sets.  Any  system  for  indexing, 
browsing  or  searching  video  databases  requires  that  video  content  be  analyzed  at  some 
stage  to  identify  key  shots  and  scene  changes,  and  this  analysis  should  be  automated 
if  huge  databases  are  to  be  accommodated.  Perhaps  less  obviously,  efficient  allocation 
of  network  resources  for  transmitting  a  large  number  of  video  sequences  can  be  aided 
by  incorporating  some  understanding  of  the  organization  of  video  content  within  each 
sequence. 

Mr.  Joyce’s  papers  [1,  3]  propose  a  fast,  new  approach  to  identifying  shot  and  scene 
boundaries  in  a  video  sequences.  The  approach  addresses  all  scene  changes,  abrupt 
cuts  as  well  as  gradual  transitions  of  various  types:  dissolves,  fades,  wipes,  etc.  The 
new  approach  operates  on  a  compressed  video  representation,  requiring  only  partial 
decoding  of  the  compressed  video  stream  and  allowing  it  to  operate  faster  than  real 
time.  Simulations  show  that  the  accuracy  of  the  new  approach  is  comparable  to  that  of 
previously  known  algorithms  that  have  much  higher  complexity. 

Mr.  Joyce’s  papers  [2,  4,  5]  propose  an  improved  approach  to  allocating  network 
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resources  for  transmission  of  video  sequences.  The  accuracy  of  any  resource  allocation 
method  depends  critically  on  its  prediction  of  future  traffic  patterns.  This  work  proposes 
a  systematic  approach  to  predicting  future  video  traffic  patterns  based  on  both  an  analy¬ 
sis  of  video  content  and  available  short-term  bandwidth  statistics.  Experimental  results 
show  a  smaller  mean-square  resource  prediction  error  and  higher  overall  link  utilization. 
The  journal  paper  [2]  appears  in  a  special  issue  of  IEEE  Trans,  on  Multimedia  focusing 
on  ”  Multimedia  over  IP” . 


1  Personnel 


Mr.  Robert  Joyce  was  the  only  person  funded  on  this  project.  Mr.  Joyce’s  participation 
in  this  project  contributed  to  his  earning  the  M.A.  degree  in  Electrical  Engineering  from 
Princeton  University  in  November,  1999.  The  research  of  this  project,  and  continuing 
research,  are  supporting  Mr.  Joyce’s  candidacy  for  the  Ph.D.  in  Electrical  Engineering, 
which  he  expects  to  receive  in  2002. 
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